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Vor Ablaufderfiir Anderungen der Ansprikche zugelaxsenen 
Frist Verdffentlichung wird wiederkolt falls Anderungen 
eintrtffen. 



(54) Title: METHOD AND DEVICE FOR DETERMINING THE PHASE- ANDfOR AMPLITUDE DATA OF AN ELECTROMAG- 
NETIC WAVE 

(54) Bezefcfanung: VBRFAHREN UND VORRICHTUNG ZUR BESTIMMUNG DER PHASEN- UND/ODER AMPUTUDENINFOR 
MATION EINER ELEKTROMAGNETJSCHEN WELLE 



(57) Abstract 

The invention concerns a method and corresponding device for determining the phase- and/or 
amplitude data of an electromagnetic wave. In order to bring about the spatial depth resolution of the 
image data obtained with such a method, die method according to the invention comprises the following 
steps: an electromagnetic wave is beamed onto the surface of a photonic mixed element comprising at 
least one pixel, the pixel having at least two light-sensitive modulation light gates G„ and G*n and 
associated accumulation gates G» and Gb; modulation light gate voltages U«n(t) and IW0> which are 
configured as U«n(t) « U 0 + U m (t) and IWt) - U c - Umft), are applied to me modulation light gates 
G^ and Gtm; a direct voltage, whose magnitude is at least the same as that of me total of U 0 and the 
amplitude of the modulation voltage U m (t), is applied to the accumulation gates G, and G&; the charge 
carriers produced in the space charge region of the modulation light gates G m and Gtm by the incident 
electromagnetic wave are subjected, as a function of the polarity of the modulation light gate voltages 
U«n(t) and Ut»(t), to the potential gradient of a drift field and drift to the corresponding accumulation 
gate G« or Gb; and the charges q a and qt which have drifted to the accumulation gates G, and Gb, 
respectively, are diverted. The corresponding photonic mixed element has at least one pixel which 
comprises al least two light-sensitive modulation light gates (Gam, Gbn) and accumulation gates (G* 
Gb) which are associated with the modulation light gates and are partitioned with respect to the incident 
of photonic mixed elements can be assembled to form an array. 
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(57) Zusnmmfntbwamg 



Die vorlieeende Erfindung betriffi ein Verfahren air Bestimmung der Phasen- undVoder AmplltudetunfornuMMn i etaer elektromag- 
netischen WeUew^ eine ents^echwde Vorrlchtung. Urn eine fSumliche rwfenaufltaung dexmit eiiiem aoteben Verfahren bet emer 
VomchtuM gewonnenen Bildtaformaiion «i erhalten, wW erfindungsgemaB ein Verfahien vorsertbg^ ta ton erne elebromagnetb. 
cteWdlTanf die Oberflache eines mindesten. ein Pixel aufweisenden photoniscben Mischelementes ewgertahlt wud, wota. da. ftxel 
mlbdaWB rwel licbtempfindliche ModutotionsphoCogates C und 0 to und rugeordnete Akicumulationsgates G. und G» mifweUt;bei dem 
S^e13w^S«SK!a«« G«. und Co, Mod lI !ation S ph 0 »gate J pann U ng e n tWt) und IWt) angdeg* werten, d>e als IWt) - TJ. 
ZlJ mund IUO. UmMfauMestaitet slnd; bei dem an die Akkumulationsgates G. und C b eine Gleichspannung angelegt wild, deien 
Mirirtesim so girf wie der Beting der Summe aus U, und der Amplitude dcr Modulationt^rong U„(t) ist bd dem d* ta der 
Sriimgszone der ModularJonspbotqgates G„ und G*. von der einfallenden elekotanagneaschen WeUe erzeugta Ladongsbager m 
AtKS^a der Want* dw M^aUonsphologalespannungen IWO und IWO don Potcntudgeffflte «no jMftfdte ai*g«em 
w^undzum entspiecnenden Akkumutationsgate 0. oder Gb drifter, und bei dem die jeweils zu den A^uhtonagates G, und Gt 
^SlTlXigen q. und Qb abgekitet werden. Das entsprechende photonische Miscbelement hat rmmk^ eta Pixel, welches min- 
fcstenswei InZeWpDndlicta TModulatioiisphotogatw ((J- Gt.) und den Modidauonsphotogaies ^rfnet^ gcgenOberder einfallenden 
eSnagTSen Wefle abgeschooete Akkumulationsgates (G* Gb) aufweist Mehrere photauscbe Mischeleroeiite kftmen zu einem 
Array zusammengeschaltct werden. 
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Method and apparatus for determining the phase and/or 
amplitude information of an electromagnetic wave 

The invention concerns a method and an apparatus for 
determining the phase and amplitude information of an 
electromagnetic wave. 

The term phase here generally stands for phase transit 
time and for the designation transit time which is also 
used according to the respective signal shape involved. 

Hereinafter reference is made to a light wave instead 
of an electromagnetic wave. That however does not denote 
a restriction only to the spectral range of visible 
electromagnetic waves, but is only for the purposes of 

simplification. 

For the measurement of frequency components in terms 
of amplitude and phase in wide-band and high-frequency 
signals, the electronic measuring art and communication art 
frequently use phase detectors which multiply or mix the 
unknown signal with a sine oscillation and determine the 
steady component which occurs in the presence of a signal 
component of the same frequency by integration or low-pass 
filtering. 

That procedure produces the correlation function of 
the unknown signal with the mixing signal for a given, 
adjustable relative phase position. By altering the mixing 
frequency (sweep) the unknown signal can be broken down^ 
into its spectral components. Steaay component, varying 
amplitude and phase of the~unknown frequency component of 
the same frequency can be determined by at least three 

phase positions. 

The investigation of corresponding optical signals 
which have acquired increasing significance' in the 
measuring and communication arts is implemented nowadays 
inter alia by way of wide-band photodetectors as electro- 



optical transducers with subsequent electronic measurement 
value ascertainment, as previously described for electrical 
signals * 

Because of the high level of expenditure involved 
5 those methods and the corresponding measurement apparatuses 
are usually only of a one- or two-channel nature. In the 
case of optical signals however very many parallel channels 
- in particular entire image sequences - with high 
frequency components frequently have to be surveyed 
10 simultaneously. 

Besides the spectral modulation properties of two- 
dimensional light waves, an aspect of increasing interest 
is the rapid run of the envelope in space and time. In 
addition there is a wish to provide for rapidly and 
15 accurately surveying 3D-objects, for example by way of 
optical radar processes, which requires very fast detectors 
in the sub-nanosecond range, as a result of the light speed 
of the echo signals. At the same time they should be 
available as a detector array if there is desire to avoid 
20 the time-consuming operation of scanning the actively or 
passively bright 3D-objects. 

Such a 3D- camera is proposed in DE 44 39 298 Al which 
the present invention takes as its basic starting point. 

Figure 10 is intended to illustrate that 3D-camera 
25 which is based on the echo transit time or phase transit 
time process. The HF-modulated light wave 101 which is 
irradiated by a modulated light transmitter 107 and 103 and 
reflected by the 3D-object 100 contains all the depth 
information in the delay in respect of the phase front. If 
30 the incident light wave is modulated once again in the 
reception aperture 102 with a two-dimensional, optical 
mixer 104 of the same frequency, which corresponds to a 
homodvne mixing or demodulation process, the result is a 
steady high-frequency interf erogram . 
35 That HF- interf erogram can b recorded with a 

conventional CCD-camera 105 and subjected to further 




3 

processing with an image processing arrangement 106. 
Integration of the steady component of the mixed product in 
the CCD -photoelectric charge corresponds to the formation 
of the correlation function of the two mixing signals. _The 
5 distance -related phase delays due to the echo transit times 
and the amnlitudes can be calculated pixel-wise from three 
or more interf eroarams by virtue of different phases of the 
demodulating mixing frequency, for example 0°, 120° and 240° 
or 0°, 90°, 180° and 270°, and thus the 3D-depth image ca n be . 
10 reconstructed. 

The two-dimensional optical mixer 103 or 104 which is 
also referred to as a spatial light modulator or SLM 
comprises in that case, for example a PocEel cell which has 
a series of serious disadvantages which are described in 
15 the literature. 

Further implementation options are afforded by LCD- 
windows which are admittedly inexpensive but which are 
about a factor of 1000 too low in terms of the desired band 
width . 

20 The use of a so-called microchannel plate, as is used 

in image amplifiers, is also expensive and costly. The 
gain can be modulated by modulation of the acceleration 
voltage which is applied to the microchannels and which 
influences the secondary electron emission in the 
25 microchannels. 

Furthermore, the state of the art sets out a proposal 
for a 2D- correlator based on a CCD-photodetector array: 
"The Lock-In CCD-Two-Dimensional Synchronous Detection of 
Light" by Spirig, Seitz et. al., published in IEEE Journal 
30 of Quantum Electronics, Vol. 31, No. 9, September 1995, 
pages 1705 - 1708. There, a photopixel is interrogated by 
way of four transfer gates in order to ascertain the pnase 
of sine-modulated light. For each sine period, a 
respective equidistant sample is taken with the four 
35 transfer gates, whereby the phase can be easily calculated. 
That procedure is too slow for the indicated problems as 




# 



4 

the harmonic light signal is firstly integrated on during 
a scanning duration which significantly delimits the band 
width. It is only then that the desired mixing process is 
implemented with the stored charge being taken over as the 
scanning sample. 

The object of the present invention is therefore that 
of providing a method and an apparatus for determining the 
phase and/or a^lituda^infprmation thus the envelope of 
a light wave, which permit a simpler, wider-band and less 
expensive correlator concept and rapid 3D-object surveying 
by way of a predeterminable lighting. 

The above -indicated object is now attained by the 
method as set forth in claim 1 and by the photonic mixing 
element as set forth in claim 14, by the mixing element 
arrangement set forth in claim 20 and by the apparatus set 
forth in claim 23. 

The principle according to the invention is based on 
a drift produced bv the modulation photogate voltage and 
separation of the minority charcre carriers pnoto- generated 
by the light wave in the material beneath at le^sfc^iiwo , 
^Igceat light- sensitive raoduittcxon photogates. In this 
case those charge carriers drift under the influence of the 
modulation photogate voltages U m (t) and U ta (t) applied to 
the modulation photogates, depending on the respective 
polarity or phase involved, to the accumulation gates which 
are biased with preferably double the dc voltage U A and U b . 
The modulation photogate voltages U.«(t) and l^tt) are 
preferably complementarily applied and are preferably 
composed of a bias voltage U 0 and the modulation voltage 
+U il (t) and -Ujt) respectively superimposed in push-pull 
relationship. Tbe two modulation photogates together 
preferably form a. ©guar? surface^ A pixex with only two 
modulation photogates can also be referred to as a dual 
pixel . 

This principle according to the invention presupposes 
the photoelectric quantum effect, caused by electromagnetic 



.wj^es. Nonetheless, reference will always be made to light 
waves, without this being interpreted as a limitation. 

The actual mixing or multiplication process lies in 
the modulation, voltage -dependent .or phase -dependent drift 
pf the .. photo-generated charge carriers to . the right or t o 
the left side of the modulatioa photogate ("charge swing") . 
In that respect the charge difference between the charge 
carriers which are separated in that way and collected 
under the accumulation gates and transmitted to the 
electronic reading-out system, having regard to integration 
in a predetermined time, represents a measurement in 
respect of the correlation function of the envelope of the 
incident modulated light signal and the modulation voltage 
U.(t) . 

At the same time the charge sum of those charge 
carriers which have drifted to the accumulation gates and 
passed on remains uninfluenced by the position of the 
charge swing and is available as suitable pixel intensity 
or as pixel grey value. 

In order to determine the relative phase or time delay 
of the incident light wave, it is necessary - as described 
above - to implement three measurements in respect of the 
three parameters dc voltage component and ac voltage 
component and relative phase. Therefore, it is possible 
to involve a configuration of the pixel of the photonic 
mixing element with three light-sensitive modulation 
photogates which are acted upon by modulation photogate 
voltages which involve three different phase shifts 
relative to the light wave irradiated by the transmitter. 

Desirably however to determine the phase of the 
reception signal at each pixel of the photonic mixing 
element from the resulting correlation amplitudes, use is 
made of four different measurements in regard to four 
different phases of the mixer signal. That provides f r 
over-d termination, by means of which the noise can be 
significantly reduced. 



• 
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The push-pull arrangement of the modulation photogate 
voltages at two modulation photogates per pixel provides 
that two respective ones of those measurements are 
implemented at the same time. Therefore, for example in 
5 the case of HF-modulation, it is sufficient to implement 
two measurements which are respectively displaced through 
90° at 0°/180° and also at 90°/270 6 phase difference in 
respect of the modulation photogate voltages U am (t) and 
U^tt) respectively with respect to the phase of the 
10 radiated light in order to acquire the four different 
measurement values necessary, 

A particularly preferred arrangement therefore is one 
in which the photonic mixing element respectively forming 
a pixel comprises four symmetrically arranged modulation 
15 photogates, wherein each two respective mutually oppositely 
disposed modulation photogates are acted upon with push- 
pull or 180°-phase-shifted modulation photogate voltages, 
wherein the two measurements which are respectively 
displaced through 90° and which have been described 
20 hereinbefore in connection with the dual pixel, with a 
0°/l&0° and also 90°/270° phase difference of the modulation 
photogate voltages, are implemented simultaneously in this 
case. Such a pixel can also be referred to as a quadruple 
pixel . 

25 Furthermore, for calibration of the phase shift of the 

modulation photogate voltages U M (t) and U^tt) it is 
preferably possible for a part of the light waves 
irradiated by the transmitter to be directed as a reference 
directly onto at least one of a plurality of pixels of an 

30 arrangement of a plurality of photonic mixing elements. 
The phase and amplitude information obtained from that 
directly irradiated pixel can then be used for the 
calibration operation or can be employed for adjustment of 
the phase shift to a predetermined value. 
35 Conversely, in the case of ind pendently excited, 

unknown modulation of the incident light wave radiated by 
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an active object, by means of at least one photonic mixing 
element, it is possible to measure the light wave with the 
known high level of resolution of a lock- in amplifier. For 
that purpose the photonic mixing element together with a 
5 tunable modulation generator which is in place of the 
transmitter forms a phase-lock loop. In addition, both in 
lock- in amplification the phase- lock loop is used for 
example for HF-modulation and also the delay-lock loop is 
used for digital modulation. 
10 For surveying passive objects, modulation of the 

irradiated light and corresponding modulation of the 
modulation photogate voltages U^tt) and U^tt) respectively 
can be implemented in various ways. First of all it is 
possible to effect continuous HF-modulation, in which case 
15 the charge differences and the charge sums are read out 
repeatedly at intervals which can be retroactively 
influenced by the pixel intensity, for evaluation of the 
phase and amplitude information of the light wave. 

An advantageous procedure is an intermittent mode of 
20 operation with pulse-form HF-modulation and lighting, for 
example in order for example in each case briefly to exceed 
an interference background lighting. In that case only the 
photo-generated charges are respectively integrated during 
the HF-pulse and then evaluated. 
25 In determining in particular the phase or transit time 

information of reflected light waves, to increase the level 
of phase or transit time resolution, it is possible to use 
the HF-pulse compression process known from the radar art, 
with narrow correlation f mictions, for example the chirp 
30 procedure. In that case, both the modulation signal of the 
individual photonic mixing element and also the light wave 
of the transmitter, which lights with a predetermined phase 
r lationship, and thus also the light wave reflected with 
the phase relationship being sought, is repetitively 
35 modulated with a chirp. By virtue of chirp modulation, in 
a suitable manner, the insertion of an adjustable delay 
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between the modulation photogate voltage of the photonic 
mixing element and the light irradiated by the transmitter 
provides for resolving multiple targets or suppressing 
troublesome multiple reflections of a lit scene. 
5 Pseudo-noise modulation (PN-modulation) described 

hereinafter is available as a further form of modulation, 
both as base band-PN- and also HF-PN-modulation. A 
sampling procedure with sample-and-hold operations in the 
case of repetitive light signals is a special case of 
10 mixing and correlation with needle pulses. The photonic 
mixing element according to the invention can 
advantageously be used in this case also and for other uses 
of pulsed modulation. 

The modulation modes referred to are per se all known 
15 from the state of the art. 

The charges which have drifted to the accumulation 
gates can now be the subject of further processing in 
various ways. On the one hand, the photonic mixing element 
can be constructed using CCD-technology, in which case the 
20 charges are collected or integrated beneath the 
accumulation gates and then displaced in conventional 
manner to the CCD- read-out circuit, for example in a three- 
phase shift cycle, and read out by way of p- or n- 
dif fusion. 

25 On the other hand, the photonic mixing element can be 

embodied using CMOS-technology as an active pixel element 
with pixel-specific electronic reading-out and signal pre- 
processing system. In that case, in practice the reading- 
out circuit which is conventional in CCD- engineering is 
30 taken at both respective sides directly to the modulation 
photogate. In that case the accumulation gates are 
preferably in the form of blocked low-capacitants pn-diodes 
and transmit the arriving photo-generated charges 
preferably directly by way of the electrodes and Gb to 
35 the electronic pixel reading-out and signal pre-processing 
system for storage and processing there. 
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In the latter case therefore the two charge components 
of the charge swing are continuously read out and can be 
stored practically in a reaction- free manner, for example 
with a charge amplifier, on a respective downstream- 
5 connected capacitor. 

The state of the art provides that, before each new 
measurement operation, the involved, charged-up capacitors 
are discharged by means of electronic reset switches and 
that desirably the fault voltages measured in the reset 
10 condition are used for correction of the actual measurement 
values. That use of the pixel-wise reaction-free reading- 
out procedure affords the advantage that the entire 
dynamics of the photonic mixing element and therewith the 
measuring method can be considerably enhanced in comparison 
15 with implementation using CCD- technology. 

In a further preferred manner it is possible to 
directly compute the phase and amplitude information in an 
electronic pixel reading-out and signal pre-processing 
system, preferably in the form of on-chip integration. 
20 Such an application-specific opto-electronic chip (ASOC) or 
such an active pixel sensor (APS) enhances the measuring 
rate and permits pixel-wise pre-processing of the phases 
and/or amplitudes . 

An important advantage of the present invention is 
25 that modulation is effected simultaneously with charge 
generation and separation. In other words , detection and 
mixing take place at the same time and without additional 
noisy and band-limiting intermediate stages. Therefore, 
the time drift errors which occur inter alia in the state 
30 of the art are prevented, the charge modulation and 
integration operations which are separated in terms of time 
and space from the detection operation necessarily occur 
and are not to be suppressed. 

A further advantage of the present invention lies in 
35 the high limit frequency of the photonic mixing element. 
The limit frequency of charge transfer by the push-pull 
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modulation voltage is comparable in terms of the maximum 
drift length or transfer distance, that is to say the sum 
length of the modulation photogates, with the limit 
frequency of corresponding MOS -transistors, and thus 
5 attains the GHz-range. In addition, troublesome common- 
mode signals are suppressed by virtue of anti- symmetrical 
charge carrier separation and difference formation. Each 
interference signal which does not correlate with the 
modulation signal, for example the background lighting, is 
10 suppressed in the charge difference, and that results in a 
high signal-to-noise ratio. Furthermore, there is only a 
slight time drift because of the combination of detection, 
mixing and charge carrier integration and difference 
formation on the same chip. In addition, a combination of 
15 practically all measurement functions becomes possible 
within a single semiconductor structure. 

In comparison with the state of the art disclosed in 
DE 44 39 298 Al with the use of Pockel cells as modulators, 
only low modulation voltages in the 1 instead of 1000 volt 
20 range are necessary. In addition, a 2D- arrangement of 
photonic mixing elements according to the invention ensures 
a large aperture on the receiver side. 

In addition, no coherent or polarised light is 
required for determining the phase and/or amplitude 
25 information. Accordingly it is possible to use further 
specific properties of the incident light waves by the 
upstream arrangement of selective filters, for example in 
respect of polarisation and wavelength of the light. In 
addition, the arrangement affords a high level of 
30 sensitivity and a high signal-to-noise ratio by virtue of 
the elimination of the electronic mixers and wide-band 
photodetector amplifiers which are used in accordance with 
the state of the art. 

The spectral optical band width of the light waves to 
35 be surveyed is determined by the spectral photosensitivity 
of the material used in the space charge zone under the 
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photogates, that is to say for example in the case of 
silicon approximately the wavelength range of 0.3 to 1.1 
/im, in the case of InGaAs about 0-8 to 1.6 M m in the 
case of InSb about 1 to 5.5 /im. 



zero-, one- or two-dimensional arrangement, and thus afford 
a wide spectrum of use geometries. In that respect, 
several 100,000 photonic mixing elements can be operated in 
parallel relationship with a modulation band width of for 
10 example 10-1000 MHz, so that for example a camera shot of 
a 3D- scene can be implemented extremely quickly, with 
determination of the distance information in each pixel. 
The phase image <p (x,y) or - in the case of modulated 
lighting - the distance image or depth image with the 
15 radius vector or voxel distance R(x,y) is determined in 
pixel -wise manner by way of the charge differences of the 
charges which flow to the accumulation gates and which are 
read out. The corresponding charge sums afford the 
conventional pixel grey value A(x,y) . The two can be 
20 combined to give the scaled grey value image or the 3D- 
image A(x,y, z) . 

In that respect, the 3D-image repetition rate is in 
the range of about 10 Hz to over 1000 Hz and depends on the 
number of photonic mixing elements used and the level of 
25 light intensity. By means of additional colour filters, it 
is possible to obtain the usual colour values red (x,y) , 
green (x,y) and blue (x,y) of the distance image R(x,y) . 

The integrated structure of mixing and charge carrier 
integration not least also provides for a simple structure 
30 in respect of the photonic mixing element. Finally, there 
is no need to involve particular expense in the reception 
channel for a conventional optical imaging system is 
sufficient for imaging of the incident, possibly reflected 
light wave, if a one- or two-dimensional scene and not just 
35 a point is to be r corded. The measuring apparatus can be 
flexibly adapted to diff rent 3D- scenes by virtue of 
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The photonic mixing elements can be disposed in any 
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synchronous zoom of the optical transmitting and receiving 
system. 

In the case of the method according to the invention 
and the corresponding mixing element or an arrangement of 
5 a plurality of mixing elements, it is desirable if the 
pixel phase or the pixel transit time and the pixel 
brightness are ascertained directly by means of an active 
pixel sensor structure (APS) and then read out selectively 
or also serially preferably by way of a multiplex structure 
0 disposed on the same chip (the so-called on-chip multiplex 
structure) . That increases the processing speed and also 
reduces the number of further components required. 

If moreover pixel brightness is evaluated as the sum 
of the charges of the associated accumulation gates, as a 
grey value image, a particularly preferred embodiment of 
the invention is one which, in the case of background 
lighting, that is to say in the case of non-modulated 
lighting which is present beside the modulated lighting, 
eliminates by computation the charges produced by that 
additional lighting at the accumulation gates, by a 
procedure whereby the difference is formed between the grey 
value images which are achieved on the one hand with 
modulated lighting switched on and on the other hand 
without the modulated lighting, that is to say after the 
modulated light source is switched off. No correlation 
information is contained in that basic brightness or that 
base amount of the charges at the accumulation gates so 
that the actual correlation information appears more 
clearly after subtraction of that base amount. 

As already mentioned it is obviously appropriate if a 
plurality of the mixing elements are used either in a 
linear array, a surface array or a spatial array. In that 
respect, the term "linear" array is intended to mean not 
only a set of mixing elements which are arranged in a 
straight row in side-by-side or successive relationship but 
generally a set of mixing elements which are arranged along 
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a line, wherein said line can be straight or also curved. 
In the case of the surface arrangements also, it is not 
only possible to provide planar mixing element arrangements 
in the form of a rectangular matrix even if that may also 
5 be preferable for practical reasons, but in principle the 
mixing elements can be arranged in accordance with any 
desired pattern and also on a curved surface, for example 
on the inside surface of a spherical shell. It is also 
possible to use arrays of the mixing elements on angled 
10 surfaces, that is to say simultaneously on two surfaces 
which include an angle with each other, and such 
arrangements are appropriate for given applications. 
Arrangements of that kind are embraced by the term "spatial 
array" . 

15 In the case of such arrays comprising a plurality of 

and possibly several hundred or thousand mixing elements, 
an advantageous and desirable configuration of the method 
according to the invention is one in which at least one of' 
the pixels or mixing elements is directly irradiated with 
20 a part of the intensity-modulated electromagnetic wave 
serving as lighting, in which case the measurement result 
obtained in that way is used at said at least one pixel for 
calibration of the other phases and brightness results. In 
that respect it is desirable if such a reference pixel is 
25 acted upon by the transmitter with selectively different 
levels of intensity or, for the situation where a plurality 
of reference pixels are used, each of those pixels is acted 
upon by a different level of intensity. That makes it 
possible to avoid errors which can possibly occur by virtue 
30 of the large dynamic scope of the measurement signals. 

In the case of a one- or mult i -dimensional mixing 
element arrangement of the above-indicated kind it is 
desirable if the pixels are constructed using MOS- 
technology on a silicon substrate and can be read out with 
35 a multiplex structure, preferably with a CCD -structure. 

It will be appreciated that the mixing elements 



according to the invention are readily suitable for use in 
a digital photographic camera or video camera. For that 
purpose, it is only necessary to provide a suitable mixing 
element arrangement (for example in the form of a 
5 rectangular matrix) with integrated receiving optics, 
electronic evaluation system and signal processing for the 
difference signals, the sum signals and the associated 
reference signals, together with a digital memory for the 
grey value image computed therefrom, and the transit time 
10 or distance image. The arrangement also includes a 
suitable transmitter or a suitable light source which 
radiates a three-dimensional scene with modulated 
electromagnetic waves or modulated light, and transmitting 
optics which are suitably adjustable to the receiving 
15 optics, wherein all of those components are combined 
together to constitute a compact unit as a digital camera. 
In that respect the difference between a digital 
photographic camera and a digital video camera is 
essentially only that, in a corresponding video camera, a 
20 relatively large number of images has to be recorded and 
stored in correspondingly short intervals of time so that 
suitable devices must be provided for the storage and 
reproduction of corresponding image sequences. 

It will be appreciated that in addition in all uses 
25 lighting or illuminating a scene can be implemented with 
modulated light from various spectral regions, so that the 
colour components or chromatic components of the images, 
which are obtained in that way, can be used to acquire and 
reconstruct complete colour images with the spatial depth 
30 information which is supplied at the same time. 

For a higher band width and for example also for 
improved edge detection, it may be desirable to use a 
microlens optical system in which associated with each 
mixing el ment or pixel is a microlens optical system which 
3 5 reduces the incident light to the central region of the 
pixel so that deviations from the ideal potential 
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configuration at the modulation gates which occur in 
particular in the edge regions of the photosensitive 
surfaces are practically removed. In addition, out -of - 
focus imaging, which is produced by means of the microlens 
5 optical system, in the detector plane of the mixing 
elements, can ensure that the imaging of edges, the imaging 
of which extends randomly in the centre between the two 
pixel halves, does not result in the generation of 
difference charges at the accumulation gates, which 
10 simulate a correlation or false depth information. 

Arrays with the photomixing elements according to the 
invention are also highly suitable for detecting and 
possibly also tracking predetermined one-, two- or three- 
dimensional structures in the field of view of the 
15 arrangement in question and with consideration additionally 
being given to the depth information or the object distance 
of the object which is being sought and which is possibly 
to be tracked. 

In specific terms, selectively determining the 
20 amplitudes and the displacement of the X-, Y- and the time 
coordinate T of the modulation signals by (AX, AY, AT) 
(wherein X and Y define two linearly independent 
coordinates which extend on the plane of a mixing element 
matrix and time T means the transit time delay of the 
25 modulation signals) provides for the implementation of a 
three-dimensional correlation, whereby a predetermined 
three-dimensional object is sought in space, detected and 
possibly tracked. 

The photomixing element according to the invention 
30 additionally also has a wide area of application in the 
field of optical data transmission. In that respect the 
photomixing element according to the invention is simply 
used instead of a photodiode in a conventional optical 
signal r ceiver, possibly inclusive of signal regeneration, 
35 wherein the shape of the modulation signal is adapted in 
the optimum manner to the signal shape and the phase of the 
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modulation signal is also adapted in optimum manner in a 
phase -lock loop to the phase position of the reception 
signal. In other words, the clock is obtained from the 
signal itself and used for optimum weighting of the 
5 reception signal, whereby the signal is separated in 
optimum fashion from the troublesome, noisy background. In 
that way, sensitivity and accuracy in respect of optical 
data transmission can be considerably improved in 
comparison with conventional photodiodes. This could in 
10 particular also permit a considerable increase in the 
length of the optical transmission sections without 
intermediate amplification and a higher number of parallel 
communication channels in a time, frequency and code 
multiplex mode- 
ls Finally, the photomixing element according to the 
invention can also be used for example in optically-based 
position detection systems, wherein the mode of operation 
is in principle similar to that involved in the known GPS- 
system which permits very accurate determination of 
20 position by means of satellite transmitters which permit 
the encoded radiation of signals. In a corresponding 
optical position detection system the satellite transmitter 
which is known from the GPS-system would be replaced by a 
widely dispersive, modulated light source which is arranged 
25 correspondingly closer to the object whose position is to 
be determined, for example by means of laser diodes and an 
optical dispersion or scatter system, while the receiver is 
formed by one or more photomixing elements on the object, 
preferably by a plurality of photomixing elements which are 
30 oriented in various directions in order to detect the 
signals from light sources stationarily arranged at various 
points, with different modulations. In that case the 
encoded modulation permits a clear association of 
stationary light sources and the object whose position is 
35 to be determined, as well as the associated signal transit 
times, by means of which the position is determined. 
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A further use is that of a demultiplexer for optical 
data transmission. Encoding in the form of special 
modulation and the associated correlation by means of the 
photomixing element permits a clear association of various 
5 channels* 

A further application and use of the high level of 
phase sensitivity of the photomixing elements according to 
the invention lies in the measurement of the Sagnac effect, 
that is to say the transit time or phase shift of light 
10 waves in rotating reference systems. For that purpose, 
modulated light is coupled into an optical fibre which is 
preferably laid in a plurality of turns and the output of 
the optical fibre lights one of the photomixing elements 
according to the invention. The modulation gates of that 
15 mixing element are modulated with the same frequency as the 
coupled- in light waves so that the correlation result in 
the form of the charge distribution at the photomixing 
element supplies a measurement in respect of the current 
frequency or phase shift. During each revolution of the 
20 reference system in which the axis of rotation is not in 
the plane of the turns of the optical fibre or optical 
waveguide, frequency and transit time and therewith also 
phase position change and are automatically detected by the 
photomixing element. It is worth noting in that respect 
25 that, with the photomixing element, such fibre gyro compass 
systems based on the Sagnac effect can now be embodied by 
means of incoherent light, which do not give rise to any 
problems in regard to their long-term stability as the 
corresponding sources of error in accordance with the state 
30 of the art, the high-frequency amplifier downstream of the 
optical detector and the electronic mixer, are completely 
eliminated. 

In addition, besides absolute directional measurement 
which is made possible with such a system, it is also 
possible to effect spe d measurement of a moving object by 
means of the photomixing element according to the 
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invention, for example insofar as a part of the light waves 
is removed in a beam splitter before being introduced into 
the optical waveguide and is directed onto a stationary 
object, in which case the light reflected by the stationary 
object is captured by a suitable photomixing element 
receiver and evaluated in the manner which has already been 
described on a number of occasions, here in regard to the 
Doppler frequency shift. 

Depending on the respective meaning and significance 
of the additional depth information of a line or matrix 
image, a given number of photomixing elements can be 
integrated in the appropriate technology in a CCD-, CMOS- 
or TFA (Thin Film on ASIC) -image sensor. 

Furthermore, in the use of a 3D- line or matrix camera 
in accordance with the invention, it may be appropriate 
additionally to use a conventional 2D-caraera, wherein a 
preferably spectral allocation and feed of the active 
modulated illumination component to the 3D-camera, and of 
the other unmodulated illumination component, is preferably 
effected with a beam splitter. 

For uses of the photomixing elements for 3D- 
measurement or surveying, for greater distances for which 
the modulated lighting is too weak, it is possible to use 
a combination of at least two 3D-line- or matrix cameras, 
in which case in accordance with the invention measurement 
or surveying is effected in the near region on the basis of 
the transit time principle and in the far region on the 
basis of the triangulation principle with inter alia 
existing background lighting. 

In that case depth measurement in the near region is 
implemented as described hereinbefore, in this case in 
parallel by way of at least two cameras. 

For depth measurement in the far region, the optical 
axes of the cameras, which are formed by way of the PMD- 
chip centre point, are directed onto a common point of 
intersection in the volum region to be measur d, for 
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example by suitable PMD-chip displacement in the horizontal 
and vertical directions and in respect of the PMD-chip 
spacings, wherein at the same time focussing of the optical 
systems of the cameras are set to that distance. With 
suitable previous adjustment the pixel brightness values 
then coincide in that volume region of greatest depth 
sharpness . 

For the detection and identification of the objects in 
that volume region, in the event of correspondence of the 
pixel amplitudes, the sum image of the photomixing elements 
is added by a briefly applied dc modulation voltage, in 
respect of the difference image, associated with the set 
distance data and evaluated, while the non- corresponding 
pixel amplitudes are removed in the difference image by a 
modulation voltage which is set to zero, = = 0. 

In that way, by means of angle scanning, the 3D-scene 
is also measured and surveyed outside the range of the 
modulated transmitter lighting, wherein the necessary 
angles are attained both by suitable displacement of the 
PMD-chips and also by rotation of the individual stereo 
cameras and/or by pivotal movement of the entire 
arrangement . 

The many possible uses of which only some are herein 
described in part in detail and in part only briefly 
indicated are also to be found in the following list 
setting forth further possible uses, the further 
description of which would go beyond the scope of the 
present application, in which respect the following list is 
also in no way exhaustive. 

More specifically possible uses are meaningful and can 
be envisaged in the following areas: 

Digital 3D-photographic camera, 

Digital 3D- video camera, 

Danger area monitoring, 

Security engineering and "intelligent buildings", 
Occupant detection and identification in motor 



vehicles, "intelligent air bag", 

Electronic 3D-rearview mirror, 

Recognition of the traffic situation in road 
traffic. 

Autonomous vehicle navigation, 

Incoherent fibre gyro and Doppler speed 
measurement , 

Control of autonomous transport vehicles, 
Industrial cleaning robots. 

Personal identification, authentif ication and 
checking of access authority, 

Identification of objects, for example vehicles, 

Production monitoring, material testing, 100% 
quality testing, 

Electronic "3D-eye" for a robot hand, robust, 
small, all solid state, 

Vehicle speed and distance-covered measurement, 
road condition detection, traffic jam, 

Track free signalling, contact wire monitoring on 
railways, 

Medical engineering, endoscopy, 

CDMA- engineering for optical free-space or line 
communication, 

Interactive 3D-communication for example in the 
multimedia area, and 

3D-measurement of moving objects with a line of 
photomixing elements. 

In that respect the following advantages of the 
photomixing elements of the present invention are to be 
emphasised (abbreviated hereinafter as "PMD" standing for 
"Photonic Mixer Device") : 

1. PMD combines: detection, push-pull mixing and 
integration in a very small space of 1/100 - 1/1000 mm 2 =» 
electro-optical correlation. 

2. 2-times/4-times-PMD: substitute for 2 or 4 
expensive wide-band amplifiers with high dynamics and group 



21 

transit time constancy and for 2 and 4 electronic mixers 
respectively. 

3. The high level of electronic cross-talk 
sensitivity between transmitter and receiver is eliminated- 
5 4. High level of integrat ability with some 100,000 

parallel electro-optical modulators. 

5* A PMD-3D-photographic or video camera is fully 
integratable, small, light, robust and flexibly adaptable 
by an optical zoom system for light transmitter and 
10 receiver. Measurement volumes for natural surfaces, 
distances of about 20 cm to 50 m with aperture angles of 
about 5° to 50°. 

6. Extremely fast 3D-image recording in the 10 Hz - 
1000 Hz-range. Sensitivity and S/N- ratio correspond to 
presentday CCD- and CMOS-cameras. 

7. The expected depth resolution is about 0.5 nun to 
50 mm depending on the respective measurement time, 
lighting intensity, optics involved and spacing by virtue 
of optimum reference. 

8. Maximum band width according to respective pixel 
size up to the GHz -range. 

9. Modulation voltages in the range of less than 1 

volt. 

10. No coherent, polarised or narrow-band light is 
required and the spectral range depends on the light- 
sensitive material (for example in the case of InSb up to 
5.5 /xm) . 

11. Simultaneous recording of the 3D-depth image and 
the 2D-grey value image, by virtue of data fusion, affords 
optimised evaluation of the 3D-grey value image (or 3D- 
colour image) . 

12. The read-out circuit, by virtue of intensity- 
dependent variation in the integration time T ± , permits an 
increase in the dynamics by about 8 bits (factor 256) . 

The invention will now be described in greater detail 
hereinafter by means of embodiments given by way of 
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example, with reference to the drawing in which: 

Figure 1 shows in a) a view in cross-section of a 
pixel of a first embodiment of a photonic mixing element 
according to the invention using CCD- technology and in b) - 
f) the potential distribution U s (t) for the various phases 
or times of the two complementary modulation photogate 
voltages U M (t) and U^ft) , 

Figure 2 shows a block diagram of two linearly 
arranged pixels using CCD- technology including a part of an 
interline transfer reading device, 

Figure 3 is a diagram showing the intensity 
distribution of the incident light and the potential 
patterns of the voltages U^ft), U a (t), U^tt) , U^tt) and 
U b (t) in the case of HF-modulation, 

Figure 4 is a diagram showing the characteristics of 
the mixing and correlation result of the photonic mixing 
element in the form of the averaged photo -generated charge 

carrier currents I. and I b drifting to the accumulation gates 

in the case of HF-modulation in dependence on the relative 
phase or transit time shift f^-w.t , 

Figure 5 shows a diagram for PN- modulation, 
illustrating in a) the modulation signal, in b) the 
characteristics of the mixing and correlation result both 

for a dual pixel (only I, and I b ) and also for a quadruple 

pixel with I c and I d in the case of a delay in the modulation 

signal for the third and fourth modulation gates cm and dm 
of T B and in c) the difference values ^I^I^I^Tt*^^ and 

a I^-A T^ii-Tt- ( T e -T d ) which are relevant for distance 
valuation, 

Figure 6 shows in a) a view in cross -sect ion of a 
pixel of a second embodiment using CCD-t chnology of a 
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photonic mixing element according to the invention with a 
middle modulation photogate G 0 as well as the potential 
distributions under the modulation photogates and 
accumulation gates b) for a positive and c) for a negative 
modulation voltage U.ft), 

Figure 7 shows in a) a view in cross-section of a 
pixel of a third embodiment of a photonic mixing element 
according to the invention and in b) - f) the potential 
distributions for the various phases, similarly to Figure 
1, 

Figure 8 is a plan view showing a pixel of a fourth 
embodiment of a photonic mixing element according to the 
invention with four modulation photogates and four 
accumulation gates, referred to as a quadruple pixel, 

Figure 9 is a plan view showing a pixel of a fifth 
embodiment of a photonic mixing element according to the 
invention with four modulation photogates and four 
accumulation gates and a central symmetrical middle gate G 0 , 
Figure 10 is a diagrammatic view of an apparatus known 
from the state of the art for determining the phase and 
amplitude information of a light wave, 

Figure 11 is a diagrammatic view of an apparatus 
according to the invention for determining the phase and 
amplitude information of a light wave for HF-modulation, 

Figure 12 is a diagrammatic view of an apparatus 
according to the invention for determining the phase and 
amplitude information of a light wave, for example for PN- 
modulation or rectangular modulation, 

Figure 13 shows in a) a view in cross-section of a 
pixel of a sixth embodiment of a photonic mixing element 
according to the invention with electronic pixel read-out 
and pre-processing system using CMOS -technology and in b) 
and c) the potential distribution similarly to Figure 6 for 
two phases or polariti s of the modulation photogate 
voltage, and 

Figure 14 is a plan view of a pixel of a sixth 
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embodiment of a photonic mixing element according to the 
invention with four modulation photogates, four 
accumulation gates and a middle gate G 0/ of a cross -shaped 
configuration, preferably for digital modulation. 

Figure la shows a view in cross -section of an 
individual pixel 1 of a photonic mixing element using the 
example of a CCD- structure. In that case the photonic 
mixing element, besides the pixel 1, includes the 
structures necessary for the voltage supply and the signal 
take-off operations. The outer gates G scp only serve for 
electrically delimiting this pixel in relation to adjacent 
structures. 

The arrangement shown in Figure 1 is formed on a p- 
doped silicon substrate 2. The mixing or multiplication 
operation of the proposed concept will firstly be 
considered for pure CW high-frequency modulation. 

In relation to the cross -section Figure lb - f 
diagrammatical ly shows the potential distributions for 
various phases of the mixing procedure. The middle 
modulation photogates G am and represent the light- 

sensitive part and are in the inversion state. In addition 
to a positive bias voltage U 0 at the conductive or optically 
partially transparent upper cover for example of 
polysilicon they are operated with the superimposed push- 
pull voltages U B (t) . That affords the modulation voltages 
U^U) = U 0 +U n (t) and V^it) = U 0 -U.(t) respectively. 

They multiplicatively cause a separation of the 
minority charge carriers generated by the photons of the 
incident light wave in the space charge zone immediately 
beneath the insulating layer 3, for example of silicon 
oxide or silicon nitride. Those charge carriers (in the 
example in question being electrons) drift under the 
influence of the modulating push-pull voltage to the 
closely adjacent positive accumulation gat b G ft or and 
are there integrated on while the majority charge carriers 
or holes flow to the ground terminal of the p-Si-substrate. 
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Rearward illumination is also possible. 

Figure 2 shows a plan view of two pixels 1 of the 
photonic mixing element according to the invention 
including a part of an interline transfer reading apparatus 
5 7 in the form of a 3 -phase CCD shift register, at one end 
of which is disposed the electronic reading-out system with 
a diffusion junction for serial processing of the charge 
values obtained by correlation* After a predeterminable 
time T for charge accumulation under all accumulation gates 
10 of the line for example at pixel No n the charges q^ and cfc 
under G a and ^ are passed by way of the respective transfer 
gate TG a and TG^ to the 3 -phase read-out shift register. 
The delimiting separation gates G #ep protect the correlation 
pixel from undesired external influences and are preferably 
15 at ground potential. 

Figure 3 shows the voltage configurations associated 
with Figure 1. The modulation photogates G^ and G^ are 
operated by means of the modulation photogate voltages 
shown in Figure 3, including a phase -opposition HF- 
20 modulation voltage U m (t), which are described as follows: 

tf„»ff 0 +tgco» <«.t) (la) 

and 

D^U^Ujcoa (».t-180°) -CT 0 -«7^cos <«.t) ( lb ) 

Figure lb - f clearly shows the potential distribution 
U s (s) in the space charge zone above the spatial extent s of 
a representative pixel 1 for all gates in question of that 
pixel in the time sequence from t 0 to t B for the duration of 
a period T m of the HF-modulation signal. At the 
accumulation gates G a and ^ a relatively high positive 
voltage provides for the accumulation of the photo- 
generated charge carriers after they have drifted either 
predominantly towards the left or towards the right side of 
the pixel 1 shown in cross-section in Figure 1, according 
to the polarity of the modulation photogate voltages U M (t) 
and U^ft). That operation has a particular effect when 



26 



light modulation and the modulation photogate voltage U 4m (t) 



respective phase difference tp^ there is a mean preferential 
direction of the charge carrier drift to the accumulation 
5 gates G a and G*,. The associated averaged currents are 

described by T a and J* . 

The underlying correlation procedure can be 
mathematically described as follows: In the reception 
plane of the most general case of 2D-arrays of photonic 

10 mixing elements z - 0 and the incident modulated light wave 
is there generally described by (x,y, t-r) . Here, it is 
described by way of the photo -generated charge carriers 
with the push-pull modulation signal acting there, in 
general form by U B (x f y,t), approximately multiplicatively 

15 and integratively linked in terms of the charge differences 
in respect of the two accumulation gates. The 
corresponding correlation function ^ub.popt (x,y,t) is 
described for example for all averaged differences of the 

charge carrier drifts aq^t-lT^I^ (with T = integration 

20 time) to the accumulation gates G a and Gb, in the most 
general case, in dependence on location, as the triple 
convolution: 



with the transit time difference t = (popt/^m* the modulation 
25 angular frequency w n and the constants k x and k 2 which are 
dependent on structure but which are unimportant in terms 
of the operating principle. 

The photonic mixing element in accordance with the 
invention achieves that aim with a high level of positional 
30 and time resolution by virtue of the rapid separating 
charge transport of the photoelectrons and their push-pull 
storage and difference and sum evaluation. In that 
respect, by virtue of forming th difference of the 



involve the same frequency. 



Then, depending on the 
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averaged drift currents Al^uj-i.uw^t) which are time- 
dependent in the case of non-stable light waves, all 
troublesome offset components are suppressed and at the 
same time the desired correlation function in respect of 
the light signal Pop t (t-T) with the modulation voltage U B (t) 
is formed. 

That procedure is to be described in greater detail 
herein. The HF-drift field caused by way of U M (t) and 
Uj^tt) provides that the electrons drift to the respectively 
positive side. During for example the positive half -wave 
of the modulation photogate voltage U^tt) = Uo+U^t) , that 
is to say during the negative half -wave of U^ft) = U 0 -U o (t) , 
the photo-generated charge carriers will drift to the 
accumulation gate G a and are there accumulated or passed on 
as a charge quantity (see the two upper modulation 
photogate voltage distributions in Figures lb and c) . 
Figure 3, for the situation of stable, harmonically 
modulated lighting, represents the optical power per pixel 
as: 



wherein P 0 represents the mean value inclusive of the 
background lighting, P B represents the modulation amplitude, 
a) a represents the HF-modulation frequency, represents 
the phase delay and r - tp^/^ represents the corresponding 
transit time delay of the incident light wave with respect 
to the modulation phase at G^,. The total photocurrent 
generated per pixel is: 



P-^ft-T) = P 0 +P n COS (Wt-^opt) 



(3) 



i(t) = Sx-P^U-t) = S x *[P 0 +P B *COS(W (n t-^ap t )] 



(4) 



i(t) = Io+VCOSfa^t-^J 



(5) 



with the parameters i(t) = i a (t)+i b {t) , I 0 « mean value of the 
pixel photocurrent in accordance with P 0 , I n = alternating 
amplitude of the modulated photocurrent in accordance with 
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P w , and S x « spectral sensitivity. That entire photocurrent 
per pixel is divided into two components, more specifically 
into the current i m (t) of the accumulation gate G a and into 
the current i b (t) of the accumulation gate G b . As those 
5 values are integrated - in CCD-technology under the 
respective accumulation gates G a and Gb and in the case of 
CMOS- technology which reads out in pixel -wise manner 
preferably in the electronic reading system - it is 
sufficient hereinafter for consideration to be given to the 

10 mean values J« and I b of those currents. The maximum in 

terms of charge separation is achieved for the angle = 
0 and t » 0 • That situation is shown in Figure 3. 

Harmonic modulation affords, under the assumption of 
idealised conditions such as suitable modulation amplitude, 
15 negligible drift transit times, 100% modulation depth with 

P. m p 0 for the mean photocurrent s T 0 and J A respectively: 



r»-i--£oo.C^> (7) 

Figure 4 shows the configuration of these idealised 
20 mean pixel currents. They represent the opposite -phase 
correlation functions which result from the HF-modulated 
reception light and the HF-modulation photogate voltages 
applied at the modulation photogates G M and G^. The sum 
thereof corresponds to I 0 of the mean pixel light power P 0 . 
25 The total charge quantity which is accumulated over the 
time T = N*T B (that is to say over N periods T m of the HF- 
modulation voltage) affords: 

r,<T> T»q; r (t) •-js*conse.| V^u-o V m { t) -<fc ( 8 ) 

with a transit time r = 0opt/ w n corresponding to the phase 
delay. Hereinafter q» T is only identified by q a . The 
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totality of the charges of the accumulation gates G 4 and ^ 
respectively of all pixels 1 forms two locationally 
discrete HF-interf erograms, the a-interf erogram and the b- 
interferogram which is displaced through 180° with respect 
5 to the a-interf erogram, and from them, by differencing, is 
formed the transit time-determined difference HP- 
interferogram which is being sought and which is described 
by equation (2) . 



10 according to the invention which uses direct mixing on the 
basis of an array of photonic mixing elements. Compared to 
the 3D-camera concept known from the state of the art, 
which is shown in Figure 10, in Figure 11 modulation of a 
transmitter 4 for lighting of optically passive 3D-objects 
15 is implemented by direct modulation of the current of a 
laser diode. In that case modulation is produced by an HF- 
generator 13. For larger distances, it is advantageous for 
example to use a high-power laser diode array with 
preferably common modulation current and - for the purposes 
20 of eye safety - of different wavelengths. 

A first optical system 5 forms an image of the light 
wave on the surface of an object 6. The light wave 
reflected by the object S is then projected through a 
second optical system 7 onto the surface of a photonic 
25 mixing element array 8. 

The photonic mixing element array 8 is also actuated 
by the HF-generator 13, wherein actuation is effected for 
different phase shifts relative to the phase of the 
radiated light wave by the HF-generator 13 . The signals of 
30 the photonic mixing element array 8 are finally evaluated 
by an evaluation unit 9, if this has not already been done 
on-chip. 

On the basis of the measuring apparatus according to 
the invention, no additional optical modulator with a high 
35 aperture is needed for the proposed 3D-camera concept, 
beside the photonic mixing element array according to the 



Figure 11 is a diagrammatic view of a 3D- camera 
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invention, and that affords a structure which is 
economically advantageous. 

For the purposes of determining the pixel phase 
from the resulting correlation amplitudes, use is made, as 
5 set forth hereinbefore, of a total of four different 
interf erograms in the case of four different phases of the 
mixer signal. The four phases of the mixer signal arise in 
the situation where the modulation photogate voltages U M 
and Ujja are switched over from the state of the phase 
10 relationship of 0°/180° to the state of 90°/270° or delayed 
through 90°. That gives the two associated imaginary or 
quadrature components in relation to the real or in -phase 
components, from which the pixel phase being sought can be 
computed, in accordance with equation (10) described 
15 hereinafter. 

That mode of operation at the same time makes it 
possible to eliminate troublesome offset voltages which are 
produced by the background brightness and by the mixing 
operation. 

20 Besides the measuring operation which is described by 

way of example in respect of CW- modulated 3D-light waves by 
2D-correlation with a modulation voltage U a (x,y,t) 
preferably of the same frequency in the plane of the 
photonic mixing element array it is possible for the 
25 measuring apparatus according to the invention also to be 
advantageously used with modulation signals in pulse form. 

In particular pseudo-noise modulation of the light is 
advantageous for tasks involving high-precision transit 
time measurement of 3D- light waves. An embodiment by way 
30 of example for surveying or measuring optically passive 3D- 
objects is shown in Figure 12. Similarly to the embodiment 
involving harmonic modulation in Figure 11 the apparatus 
according to the invention has a suitable lighting device 
which lights the 3D-objects 6 with light which is 
35 PN (Pseudo-Noise) -modulated in intensity and the reflect d 
and received light is subject d to the correlation 
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procedure with preferably the corresponding PN-modulation 
signal which is produced by the generator 13, 

As the correlation in respect of PN- signals of that 
kind with increasing word length T„ = T B (2 H -1) resembles a 
5 triangular needle pulse with a half -value width equal to 
the bit width T B/ then for clear and complete measurement of 
the entire light volume or the entire space lit, a relative 
delay T 0 between the light -modulating PN- signal and the 
demodulating PN-push-pull voltage Ujt) of the same signal 

10 shape at the modulation photogates must pass at least once 
through the entire delay range of the maximum echo transit 
time continuously or stepwise in T B -steps. That purpose is 
served by the delay member 11 which is adjustable in 
respect of the delay T D by the control and evaluation unit 

15 9. 

Figure 5a shows the modulation signal U,(t) , in regard 
to the example of a rectangular 15 bit PN-sequence. The 
result of the correlation by the photonic mixing element is 

the averaged drift currents J, and T t shown in Figure 5b in 

20 relation to the relative delay r. 

In the case of the quadruple pixel described 
hereinafter, as shown in Figures 8, 9 and 14, the push-pull 
modulation photogate voltages which are applied to the 
modulation photogates G^ and and which are superimposed 
25 on the bias voltage U 0 are preferably delayed by T B with 
respect to the push-pull modulation photogate voltages 
applied to the modulation photogates G a and Gj,, that is to 
say U^ft) « u 0 +U.(t-T B ) and TJ^it) = U 0 -U n (t-T B ), which 
results in highly advantageous amplitude and transit time 
30 measurements. 

Except for a predeterminable delay T D in respect of the 
modulation voltages the light intensity const. *P^ t (t) 
irradiated by the transmitter 4 involves the same PN-signal 
structure. The reflection reaches the photonic mixing 
35 elem nt after the echo transit time. The correlation with 
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the push-pull modulation voltages results, in accordance 
with the respective relative transit time delay t for T D » 
0 in the ideal case without background brightness, in the 

case of the dual pixel in the mean pixel currents T m and I b 

5 shown in Figure 5b and in the case of the quadruple pixel 
with the stated T B -time shift additionally in the mean pixel 

currents I e and i„ . That correlation characteristic firstly 

reveals that a plurality of object reflections can be 
distinguished on the same radius vector, for example for 
10 distinguishing a plurality of partially transparent objects 
which are disposed one behind the other or for the purposes 
of eliminating multiple reflections. 

In addition, the sum and difference of the mean drift 
current differences, as shown in Figure 5c are preferably 
formed in succession in the case of the dual pixel and 
simultaneously in the case of the quadruple pixel in the 
respectively corresponding electronic pixel reading-out and 
signal pre-processing system 15. They permit highly 
sensitive measurements as it is only in the T B to 2T B -wide 
measurement window that signal values that are not equal to 
zero appear. Evaluation of the sum makes it possible to 
determine the relevance of a measurement on the basis of a 
minimum amplitude. The difference shows a steep linear 
configuration in the useable T B -wide measurement window, 
which permits the transit time to be determined with a high 
degree of resolution. The following applies for the 
example which is idealised here: 

<« 

The block diagram pf a corresponding measuring 
apparatus for the optical measurement of 3D-objects with 
PN-modulation based on the proposed corr lation 
photodetector array is characterised by a structure of 
particular simplicity, as can be seen from Figure 12. In 
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that case, besides the generator 10 and the delay member 
11, the same structure as that shown in Figure 11 is 
involved. 

In accordance with the invention, for the purposes of 
5 rapidly ascertaining distance with a relatively low level 
of resolution, use is also made of simple rectangular 
modulation of the transmitter 4 by the generator 10 with 
the period T and preferably the same pulse and space 
duration T B . The operation of ascertaining transit time is 
10 implemented in accordance with equation (9) . The level of 
resolution is increased stepwise by the period duration T 
which decreases with the factor 2, in which case the first 
measurement step is firstly followed by a second involving 
the same period but with a time shift T D = T/4. 
15 The cross-section illustrated by way of example in 

Figure 1 of the pixel 1 of the photonic mixing element 
according to the invention can be optimised in respect of 
its limit frequency by a suitable configuration in terms of 
the potential gradient caused by the push-pull modulation 
20 voltage. In that respect, Figure 6 shows an embodiment by 
way of example in which a middle gate G 0 is arranged between 
the modulation photogates and G^, the middle gate 

preferably being at the bias voltage U 0 and together with 
the modulation photogates and G^ forming three potential 
25 stages. What is desired is a potential gradient which is 
as uniform as possible or a modulation drift field which is 
as constant as possible, and that is achieved by increasing 
the number of stages from two to three or even more. In 
the photosensitive space charge zone the degree of 
30 definition or pronouncement of the stages decreases in any 
case with the spacing from the insulating layer 3 . That 
effect is used in a further embodiment in accordance with 
the invention, mor specifically by using what is known as 
a "buried channel", a weakly doped n-channel which is some 
35 fim away from the insulating layer and which is somewhat 
deeper in the p-substrate under the modulation photogates. 
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The arrangement also includes a shading 12 for the 
accumulation gates G m and Gb so that they are not lit by the 
light wave and additional charge carriers produced. 

Figure 7 shows a particular configuration and 
connection of photonic mixing elements in which/ in 
comparison with that in Figure 1, the two modulation 
photogates are respectively only separated by a common 
accumulation gate G. #n , thereby achieving a higher degree of 
filling action. This arrangement also has a shading 12 for 
the accumulation gates G. and G^. In this case the polarity 
of the push-pull modulation voltages or the sequence of G Wtn 
and G^ changes from pixel to pixel. That triple period of 
the gates is suitable at the same time for direct reading- 
out by virtue of operation as a three-phase shift register, 
A disadvantage which cam be tolerated in certain 
applications lies in the charge distribution also to the 
respectively adjacent pixels, which results in an apparent 
pixel size increase and a lower degree of positional 
resolution in the direction in question. 

Calculation of those interrelationships and influences 
shows that, in comparison with a 100% useful charge, upon 
evaluation of the charge differences, the central pixel 
considered acquires only 50% and the two adjoining pixels 
each acquire 25%. 

To illustrate the charge distribution, Figure 7 , 
similarly to Figure 1, shows the various phases of 
potential distribution for CW-modulation. 

Figure 8 shows a further advantageous embodiment of 
the design of a pixel of a photonic mixing element which in 
the case of CW-modulation does not require any IQ (in- 
phase, quadrature -phase) -switching- over between the I- and 
Q-states. Instead of the above -described dual pixel, the 
proposal is for a quadruple pixel with the modulation 
photogates G m , G^, G m and G^ as well as the associated 
accumulation gat s G a , G^, G c and G d , which permits 
correlation simultaneously for four phase positions, as the 
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push-pull modulation photogate voltages U aB (t) and U^tt) , 
U OT (t) and U^ft) respectively are shifted relative to each 
other, in particular in the case of HF-tnodulation through 
90°. 

5 Therefore, in an orthogonal arrangement with respect 

to the described modulation photogates G m with <p m = 0° and 
with ^bo = 180°, there are two further modulation 
photogates G^ with ^ = 90° and with ^ = 270° which are 
symmetrically integrated within the pixel and which operate 

10 on the basis of the same principle. That affords a four- 
phase charge accumulation with the individual charges q^ t 
qt, cjc and q d under the associated accumulation gates G 4/ G^, 
G c and G d or in the associated electronic reading-out 
system, wherein by means of a simple arithmetical operation 

15 the associated phase ^ t is directly computed as follows: 

^xctaB^| (10) 

For simply determining grey values of an individual 
pixel, the individual charges of all accumulation gates of 
a pixel are summed: qp lxe i - <Ja+<Jb + <Ic +< Id- The reading-out 

20 process in respect of the respective four charges is 
desirably implemented in this case by an active pixel 
design using CMOS -technology with pixel-wise integrated 
signal pre-processing. 

Figure 9, like Figure 8, shows a quadruple pixel of a 

25 photonic mixing element, but with a potential gradient 
which is smoothed as shown in Figure 6, by means of the 
central square middle gate G 0 which is preferably at the 
potential U 0 . 

Figure 14, like Figure 9, shows a quadruple pixel of 
30 a photonic mixing element with a structure which is 
optimised for digital modulation signals. The middle gate 
G 0 , arranged between the preferably square modulation 
photogates, serves in a similar manner to Figure 9 for 
smoothing the potential gradient produced by the modulation 
photogate voltage. 
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Finally Figure 13 shows a further preferred embodiment 
of a pixel 1 which, in contrast to the above-discussed 
embodiments, is implemented not using CCD- technology but 
CMOS-technology with electronic pixel-wise reading-out and 
5 signal pre-processing system 15. In this case, the mode of 
operation of the modulation voltage -dependent drift of the 
charge carriers on the charge swing is the same as in the 
above-discussed embodiments. The only difference in the 
embodiment shown in Figure 13 is the manner of implementing 
10 further processing in respect of the charges q. and <& which 
have drifted to the accumulation gates G. and Gj,. 

In the present embodiment the accumulation gates G. and 
Gt, are in the form of blocked pn-diodes. The positively 
biased accumulation gates G. and G„ are formed by n,-doped 
electrodes on a preferably weakly doped p-Si- substrate 3 in 
Figure 13. m what is known as the "floating-diffusion" 
mode of operation or in the high-resistance voltage read- 
out mode, as in the case of using CCD- technology, the 
charges q. and q„ are integrated on the capacitances of the 
accumulation gates G, and G,, and are read out in a high- 
resistance mode in the form of voltage values. 

It is advantageously also possible to use a current 
read-out mode in which the photogenerated charge carriers 
are not integrated in the potential well but are 
continuously passed by way of output diffusion by way of 
suitable current read-out circuits which are connected to 
the accumulation gates G a and G„ respectively. Those 
charges are then integrated for example on a respective 
external capacitance. 

A reading-out circuit in the current read-out mode 
which keeps the accumulation gate voltage virtually 
constant by virtue of amplifier feedback advantageously 
ensures that, upon intensive irradiation of the pixel, the 
quantity of the accumulat d charges q, and Oj, does not 
result in a reaction on or indeed overflowing of the 
potential well. The dynamics of the photonic mixing 
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element is thereby considerably improved. In this case 
also the above-specified technology involving a weakly 
doped n-channel ( "buried layer" ) under the insulating layer 
of the modulation gates affords improvements, inter alia an 
5 increase in the limit frequency. 

Constructing the photonic mixing element using CMOS- 
technology further permits the use of an active pixel 
design (APS) with which, at each pixel, a read-out and 
signal pre-processing circuit can be integrated into the 
10 photonic mixing element. That permits pre-processing of 
the electrical signals directly at the pixel before the 
signals are passed to an external circuit. In particular 
it is possible in that way to calculate the phase and 
amplitude information directly on the chip so that the 
15 measurement rate can be further enhanced. 

A further configuration of the invention provides for 
using a preferably two-dimensional photonic mixing element 
array for a three-dimensional electronic object search and 
tracking procedure of passively or actively illuminating 
objects on the basis of various criteria, such as for 
example object shape, position, colour, polarisation, speed 
vector, brightness or a combination of object properties. 
If for example in the passage of various modulation signals 
(for example frequency or code alteration) in the 3D- 
measurement of an incident light wave which can initially 
be unknown, a local correlation is found by the criterion 
of difference drift currents not equal to zero, then that 
object range can thereafter be continuously measured 
specifically in respect of said object properties and 
tracked, possibly in the event of changes, by way of a 
regulating loop which in particular also includes image 
depth. 

The photonic mixing element is used in various modes 
of operation which are set forth hereinafter. 
55 in this respect the sum charge at the accumulation 

gates G, and G b is of less interest as it always corresponds 
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to the total intensity of the incident light waves, c^+c^ = 
const . *P optjgea *T with T = integration time. 

The difference charge A^-^-^J^r-T^.r depends on a 

plurality of factors and can be used in many ways for 
5 measuring the incident light wave. For that purpose, 
consideration is given to a basic brightness which is 
always present P 0 > « P n (see Figure 3a) . 

Optionally for example when measuring an object 6 
which is lit by a transmitter 4 with modulated light the 
10 transmitter power is switched on or off and thus P. becomes 
finite or equal to zero. At the same time optionally the 
modulation voltage U n (t) either becomes zero or it is 
switched to the configuration used in the transmitter and 
contained in the incident light, or to a voltage which 
15 is constant during the integration time. 

Accordingly, with P 0 *0 that gives four important modes 
of operation: 



20 modulation signal, 

3.) With finite P B and a high-frequency modulation 
voltage Aq^ is a function of U a (t) , the relative transit 
time shift t and the incident light power component P^t) 
which is modulated in that way. 
25 4.) If during the integration time T there is an 

incident mean light intensity P 0 and a constant modulation 
voltage U^, then the difference charge Aq^ is a function of 
and the mean light power P 0 . 



30 modulated, a further configuration of the invention 
provides that the photonic mixing element is used in 
accordance with the fourth case of a possible mode of 
operation, for example for 2D-image processing. 

In that case each mixing element is actuable 
15 specifically and independently of each other, for example 



1 • ) Aqab = 0 f or P« = 0 and U. « 0 . 

2.) Aq^ « 0 with finite P m and with U n (t) as an HF- 



In the case of light waves which are not intensity 
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by pixel-wise association of a respective rapidly over- 
writable modulation voltage word for U n0 preferably by means 
of a RAM- component . Preferably evaluation is effected only 

in respect of the difference charges r*Ai^ and difference 

drift currents aI* which are approximately proportional to 

U^. In that case the modulation voltage U n0 is respectively 
derived from the modulation voltage word. 

That means that U A (t) is no longer set periodically or 
quasi-periodically as in the preceding examples of use but 
aperiodically, for example in accordance with a 
predetermined image content or in accordance with the 
measured image content. For U n (t) « 0 all difference 
currents are zero so that the associated difference image 
D(x,y) also appears with the amplitude or intensity zero. 

Difference image brightness can thus be specifically 
influenced by a variation in V n (x,y,t) . In that way in 
accordance with the invention any light waves or images, 
that is to say even unmodulated ones, can be subjected to 
versatile image processing by way of an extremely rapidly 
settable weighting function G(x,y,t) = k 1 *U I1 (x / y # t) , for 
example by way of the above-mentioned controllable, pixel - 
wise associated memory cells, such as for example the 
above-mentioned uses for object search and tracking, but in 
that case without the aspect of depth information. 
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1. A method of determining the phase and/or 
amplitude information of an electromagnetic wave 

- in which an electromagnetic wave is radiated onto 
the surface of a photonic mixing element having at least 
one pixel, wherein the pixel has at least two light- 
sensitive modulation photogates G m and G^ and associated 
accumulation gates G a and G^, 

- in which there are applied to the modulation 
photogates G^, and G^ modulation photogate voltages U M (t) 
and UtJt) which are in the form of UaJt) = Uo+U^tt) and 
U^Ct) « U 0 -U a (t), 

- wherein applied to the accumulation gates G a and G* 
is a dc voltage whose magnitude is at least as great as the 
magnitude of the sum of U Q and the amplitude of the 
modulation voltage U B (t), 

- in which the charge carriers produced in the space 
charge zone of the modulation photogates G w and G^ by the 
incident electromagnetic wave are exposed to the potential 
gradient of a drift field in dependence on the polarity of 
the modulation photogate voltages U^tt) and U^tt) and drift 
to the corresponding accumulation gate G a and G b , and 

- in which the charges q, and which have drifted to 
the respective accumulation gates G a and Gb are taken off, 

2. A method according to claim 1 

- in which an intensity-modulated electromagnetic wave 
is irradiated by a transmitter, 

- in which the electromagnetic wave reflected by an 
object is radiated onto the surface of the photonic mixing 
element, 

- in which the modulation photogat voltages Uantt) and 
U^ft) are in fixed phase relationship with the phase of the 
electromagnetic wave irradiated by the transmitter, and 

in which the charge carriers produced are 
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additionally exposed to the potential gradient of a drift 
field in dependence on the phase of the push-pull 
modulation photogate voltages U„(t) and U^(t) . 

3 . A method according to claim 2 

- in which for two different phase shifts V and of 
the modulation photogate voltages D„(t) and U ta (t) relative 
to the phase of the electromagnetic wave irradiated by the 
transmitter the charges and q* as well as and are 
taken off and the charge differences [q* - q*) and (g^ - 
gjj are formed, and 

- in which in accordance with the equation 



the pixel phase ^ of the incident electromagnetic wave is 
determined relative to the phase of the electromagnetic 
wave irradiated by the transmitter and thus the transit 
time of the electromagnetic wave received by the pixel is 
determined. 

4. A method according to claim 3 

- in which by means of four modulation photogates G„, 
Gta, and and four associated accumulation gates G„ Gj,, 
G c and G d , for two different phase shifts A rl and A„ 2 of the 
modulation photogate voltages U.Jt) = U c+ U^{t) and U ta (t) = 
q.-BU<t> andTWt) - U x *BU<t) and U^t) - U^U^t) relative 
to the phase of the electromagnetic wave irradiated by the 
transmitter, at the same time the charges q., g*, q,; and q< 
are separated and taken off, and 

- in accordance with the equation 

the pixel phase «v of the electromagnetic wave irradiated 
by the transmitter and ther with the transit time of the 
el ctromagnetic wave received by the pixel is determined. 
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5 . A method according to one of the preceding claims 

- in which the photonic mixing element has a plurality 
of pixels, 

- in which at least one pixel is directly radiated 
with a part of the intensity-modulated electromagnetic wave 
from the transmitter and 

- in which calibration of the phase shift between the 
irradiated electromagnetic wave and the modulation 
photogate voltages U„(t) and U bw (t) is implemented from the 
phase shift measured with said pixel. 

6. A method according to claim 1 

- in which an electromagnetic wave with independently 
excited, unknown intensity modulation is radiated onto the 
surface of the photonic mixing element, 

- in which the modulation photogate voltages U m (t) and 
U^ft) are produced by a tunable modulation generator, 

in which the charge carriers produced are 
additionally exposed to a potential gradient of a drift 
field in dependence on the phase of the push-pull 
modulation photogate voltages U^tt) and U ta (t) , and 

- in which the photonic mixing element and the 
modulation generator form at least one phase- lock loop and 
the electromagnetic wave is measured in accordance with the 
lock -in method. 

7. A method according to one of claims 1 to 6 in 
which a continuous or discontinuous HF-modulation, pseudo- 
noise modulation or chirp modulation is used as periodic 
modulation. 

8. A method according to claim 7 in which the 
modulation is HF-modulation and preferably the charges 
and q„ and possibly q c and for the phase shifts A, = 
0°/180° and 90°/270° are taken off. 
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9. A method according to claim 1 in which a steady- 
state modulation is used with modulation photogate voltages 
U am s U o +U m0 and « U 0 - u *o with a settable modulation dc 
voltage U m0 which is constant in respect of time and with 
which the difference image from the difference of the 
charges q» and is specifically weighted. 

10. A method according to one of claims 1 to 9 in 
which the charges q, and beneath the accumulation gates 
G 4 and G*, are integrated and read out with a multiplex 
structure, preferably with a CCD- structure. 

11. A method according to one of claims 1 to 9 in 
which the accumulation gates G a and G*, are in the form of 
pn-diodes, preferably blocked low- capacitance pn- diodes and 
preferably using CMOS- technology, and in which the charges 
q. and <& and possibly q c and q& are read out directly as 
voltage or as current. 

12. A method according to claim 11 in which the 
pixel phase or the pixel transit time and the pixel 
brightness are ascertained directly by means of an active 
pixel sensor structure (APS) and preferably selectively 
and/or serially read out by way of an on-chip multiplex 
structure . 

13. A method according to one of claims 1 to 12 in 
which the pixel brightness is respectively evaluated as the 
sum of the charges of the associated accumulation gates as 
a grey value image. 

14. A method according to one of claims 1 to 13 
characterised in that in the case of background lighting or 
an external, non-modulated additional lighting, the 
difference of the grey value images is used as a correction 
parameter on the one hand when the modulated lighting is 
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switched on and on the other hand when the modulated 
lighting is switched off. 

15. A method according to one of claims 1 to 14 
characterised in that a plurality of separate mixing 
elements are used in a linear, surface or spatial array. 

16. A method according to claim 15 characterised in 
that at least one of the pixels is directly radiated with 
a part of the intensity-modulated electromagnetic wave 
serving as lighting and that the measurement at said at 
least one pixel is used for calibration of the other phases 
and brightness results, wherein preferably the reference 
pixel or pixels is or are acted upon by the transmitter 
with different levels of intensity or levels of intensity 
which can be differently set. 

17. A photonic mixing element 

- with at least one pixel (1) , 

- which has at least two light-sensitive modulation 
photogates (G am , G^) and 

- accumulation gates (G a , which are associated with 
the modulation photogates (G wt G^) and which are shaded 
relative to the incident electromagnetic wave. 

18. A mixing element according to claim 17 
characterised in that a middle gate (G 0 ) is arranged between 
the modulation photogates (6^, G te ) • 

19. A mixing element according to claims 17 or claim 

18 characterised in that the pixel (1) has four, preferably 
symmetrically arranged, modulation photogates (G^,, G^, G mi 
GaJ and accumulation gates (G ft , Gb, G c/ G d ) . . 

20. A mixing element according to one of claims 17 to 

19 characterised in that the accumulation gates (G a , G b and 

j 
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possibly G c , G d ) are in the form of pn-diodes, preferably 
blocked, low-capacitance pn-diodes and preferably of CMOS- 
technology, and the charges qa, and possibly q cl q,, can be 
read out directly as voltage or current. 

21. A mixing element according to one of claims 17 to 

20 characterised in that for the purposes of increasing the 
maximum modulation speed the pixel is produced using GaAs- 
technology, preferably of "buried channel" type (for 
example a buried n-channel) and with an integrated drift 
field. 

22 . A mixing element according to one of claims 17 to 

21 characterised in that the pixel (1) is in the form of an 
active pixel sensor structure with partially pixel -related 
signal processing and partially line- or possibly matrix- 
related signal processing* 

23 . A mixing element according to one of claims 17 to 

22 characterised in that the shading is also extended onto 
the edge regions of the modulation photogates. 

24. A mixing element arrangement having at least two 
photonic mixing elements according to one of apparatus 
claims 17 to 23 characterised in that the photonic mixing 
elements are arranged in a one -dimensional, two-dimensional 
or three-dimensional arrangement. 

25. A mixing element arrangement according to claim 
24 characterised in that modulation photogates (G^n, G„, 0#1 ) 
and (G^n, G^^) respectively associated with two 
adjacently arranged, different pixels (n, n+1) respectively 
have a common accumulation gate (G,) and that the modulation 
photogates (G«a, n # G M#wl ) and (G^ a , G^^) respectively are 
acted upon by the same modulation photogate voltag s U w (t) 
and U^ft) . 
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26. A mixing element arrangement according to claim 
24 or claim 25 characterised in that there are provided 
devices for the direct irradiation of at least one pixel 
(1) as a reference pixel, by means of which a part of the 
intensity-modulated electromagnetic radiation emitted by 
the transmitter is directed onto the pixel or pixels in 
question. 

27. A mixing element arrangement according to claim 
26 characterised in that the devices for direct irradiation 
are equipped for a variation in respect of space and/or 
time of the intensity of the direct irradiation. 

28. A one-dimensional or mult i -dimensional mixing 
element arrangement according to one of claims 24 to 27 
characterised in that the pixels (1) are embodied using 
MOS-technology on a silicon substrate (2) and can be read 
out with a multiplex structure, preferably with a CCD- 
structure . 

29. A mixing element arrangement according to one of 
claims 24 to 28 characterised in that there is provided a 
microlens optical system which produces substantially for 
each mixing element used for image recording its own 
microlens by which the incident radiation is focussed onto 
a central region of the mixing element which can thus be 
reduced in size. 

30. Apparatus for determining the phase information 

of an electromagnetic wave 

having at least one photonic mixing element 

according to one of apparatus claims 17 to 23, 

having a modulation generator (10, 13), and 
having a transmitter (4) whose irradiated 

electromagnetic wave is intensity-modulated by the 

modulation generator (10, 13) in predetermined manner, 
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wherein the electromagnetic wave which is 
reflected by an object (6) is radiated onto the surface of 
the photonic mixing element, and 

wherein the modulation generator (10, 13) 
supplies the photonic mixing element with modulation 
voltages U n (t) which are in a predetermined phase 
relationship with respect to the phase of the irradiated 
electromagnetic wave from the transmitter. 

31. Apparatus according to the preceding apparatus 
claim characterised in that there are provided an optical 
system (7) and a mixing element arrangement possibly 
according to one of claims 24 to 29, wherein the optical 
system (7) forms the image of the reflected electromagnetic 
wave on the surface of the mixing element or the mixing 
element arrangement. 

32. Apparatus according to claim 30 or 31 
characterised in that there are provided a mixing element 
arrangement with associated optical receiving system, 
electronic evaluation and signal processing system for the 
difference signals, sum signals and associated reference 
signals, with a digital memory for the grey value image and 
the transit time or distance image, a transmitter for 
lighting a three-dimensional scene with modulated 
electromagnetic waves, and with an adjustable optical 
transmitting system corresponding to the optical receiving 
system, forming a digital 3D-photographic camera in the 
form of a compact unit. 

33 . Apparatus according to claim 30 or 31 
characterized in that to form a digital, three- 
dimensional ly recording video camera, there are provided 
mixing element arrangement with associated optical 
receiving system, electronic evaluation and signal 
proc ssing system for the difference signals, sum signals 
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and associated reference signals, with a digital memory for the grey value image and the 
transit time or distance image, a transmitter for lighting a three-dimensional scene with 
modulated electromagnetic waves, and with an adjustable optical transmitting system 
corresponding to the optical receiving system, wherein there are further provided 
6 memory means for the storage of digital image sequences. 

34. Apparatus according to claim 32 or 33 characterised in that the 
transmitter is provided with devices for emitting light waves in various spectral regions 
for producing colour images or colour image components. 

35. A method of determining die phase and/or amplitude information of an 
electromagnetic wave, said method being substantially as described herein in relation to 
any one of the embodiments with reference to the accompanying drawings. 

36. A photonic mixing element substantially as described herein in relation 
to any one of the embodiments with reference to the accompanying drawings. 

37. Apparatus for determining the phase information of an electromagnetic 
wave, said apparatus being substantially as described herein in relation to any one of the 
embodiments with reference to the accompanying drawings. 

DATED this Fourth Day of March 1999 
Rudolf Schwarte 
Patent Attorneys for the Applicant 
SPRUSON & FERGUSON 
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